Large language models and bariatric surgery patient education: a comparative readability analysis of GPT-3.5, GPT-4, Bard, and online institutional resources.

BACKGROUND: The readability of online bariatric surgery patient education materials (PEMs) often surpasses the recommended 6th grade level. Large language models (LLMs), like ChatGPT and Bard, have the potential to revolutionize PEM delivery. We aimed to evaluate the readability of PEMs produced by U.S. medical institutions compared to LLMs, as well as the ability of LLMs to simplify their responses. METHODS: Responses to frequently asked questions (FAQs) related to bariatric surgery were gathered from top-ranked health institutions. FAQ responses were also generated from GPT-3.5, GPT-4, and Bard. LLMs were then prompted to improve the readability of their initial responses. The readability of institutional responses, initial LLM responses, and simplified LLM responses were graded using validated readability formulas. Accuracy and comprehensiveness of initial and simplified LLM responses were also compared. RESULTS: Responses to 66 FAQs were included. All institutional and initial LLM responses had poor readability, with average reading levels ranging from 9th grade to college graduate. Simplified responses from LLMs had significantly improved readability, with reading levels ranging from 6th grade to college freshman. When comparing simplified LLM responses, GPT-4 responses demonstrated the highest readability, with reading levels ranging from 6th to 9th grade. Accuracy was similar between initial and simplified responses from all LLMs. Comprehensiveness was similar between initial and simplified responses from GPT-3.5 and GPT-4. However, 34.8% of Bard's simplified responses were graded as less comprehensive compared to initial. CONCLUSION: Our study highlights the efficacy of LLMs in enhancing the readability of bariatric surgery PEMs. GPT-4 outperformed other models, generating simplified PEMs from 6th to 9th grade reading levels. Unlike GPT-3.5 and GPT-4, Bard's simplified responses were graded as less comprehensive. We advocate for future studies examining the potential role of LLMs as dynamic and personalized sources of PEMs for diverse patient populations of all literacy levels.

Perceptions and Expectations Regarding the Step 1 Score Change Among Surgical and Non-Surgical Program Directors: A Systematic Review and Meta-Analysis.

There are currently no studies examining differences in perceptions and expected impact of the Step 1 score change to pass/fail between surgical and non-surgical program directors (PDs). We conducted a systematic review in May 2023 of PubMed, Scopus, Web of Science, and PSYCInfo to evaluate studies examining PDs' perspectives regarding the Step 1 score change. We performed random-effects meta-analyses to determine differences in perspectives among surgical and non-surgical PDs. Surgical PDs (76.8% [95% CI, 72.1%-82.0%], I2 = 52%) reported significantly greater rates of disagreement with the score change compared to non-surgical (65.1% [95% CI, 57.9%-73.1%], I2 = 69.7%) (P = .01). Surgical PDs also reported significantly greater rates of agreement that the score change will increase the difficulty in objectively comparing applicants (88.1% [95% CI, 84.6%-91.7%], I2 = 16.4%), compared to non-surgical (81.0% [95% CI, 75.6%-86.8%], I2 = 72.6%) (P = .04). There was less heterogeneity among non-surgical PDs (88.7% [95% CI, 86.2%-91.2%], I2 = 0%), compared to surgical (84.7% [95% CI, 79.0%-90.8%], I2 = 67.3%), regarding expected increases in emphasis on Step 2, although the difference in rates of agreement was not statistically significant. Overall, there is significant heterogeneity in the literature regarding expected changes in the residency application review process. Most PDs reported significant disagreement with the score change, greater expected difficulty in objectively evaluating applicants, and greater emphasis on Step 2, with surgical PDs reporting greater rates of disagreement, greater expected difficulty, and heterogeneity regarding expected increases in emphasis on Step 2, compared to non-surgical. Additionally, there is significant heterogeneity in the overall literature regarding expected changes in the residency application review process. Further research is needed to establish evidence-based guidelines that improve the overall residency application process for all stakeholders.

Common postbariatric surgery emergencies for the acute care surgeon: What you need to know.

ABSTRACT: The field of bariatric and metabolic surgery has changed rapidly over the past two decades, with an exponential increase in case volumes being performed because of its proven efficacy for morbid obesity and obesity-related comorbidities. Although this increased volume of procedures has been accompanied by significant decrease in postoperative complication rates, there are numerous potential complications after bariatric surgery that may require urgent or emergent surgical evaluation or interventions. Many of these risks extend well beyond the early postoperative period and can present months to years after the index procedure. Acute care surgeons are increasingly covering most or all of the emergency general surgery services at many centers and must be familiar with the numerous bariatric surgical procedures being performed and their individual complication profile to provide optimal care for these frequently challenging patients. This article provides a focused and concise review of the common bariatric procedures being performed, their early and late complication profiles, and a practical guide to the optimal diagnostic evaluations, surgical interventions, and perioperative management options. The author group includes both acute care surgeons and bariatric surgeons with significant experience in the emergency management of the complicated postbariatric surgical patient. LEVEL OF EVIDENCE: Literature Synthesis and Expert Opinion; Level V.

Providers' Knowledge and Perceptions of Bariatric Surgery: a Systematic Review.

Bariatric surgery remains underutilized despite its proven efficacy in the management of obesity. Provider perceptions of bariatric surgery are important to consider when discussing utilization rates. PubMed, SCOPUS, and OVID databases were searched in April 2023, and 40 published studies discussing providers' knowledge and perceptions of bariatric surgery were included. There were generally positive perceptions of the efficacy of bariatric surgery, although overestimations of surgical risks and postoperative complications were common. Providers' previous training was associated with knowledge and perceptions of bariatric surgery and familiarity with perioperative management across studies. These perceptions were also associated with referral rates, suggesting that inadequate provider knowledge may contribute to bariatric surgery underutilization. We advocate for increased bariatric surgery-related education throughout all stages of medical training and across specialties.

Predictors of Complications Following Bariatric Surgery for Adolescent Patients.

BACKGROUND: Bariatric surgery for adolescent patients has been shown to be safe but potentially underutilized. A better understanding of operative risk in adolescents may temper apprehension to its adoption. This study intends to examine the association between preoperative risk factors and complications following bariatric surgery for adolescent patients. METHODS: The Metabolic and Bariatric Surgery Accreditation and Quality Improvement Program databank (2015-2020) was queried for all adolescent patients (10 to 19 years). Only patients who underwent sleeve gastrectomy or gastric bypass were included. Multivariable regression examined the association between patient characteristics and complications. RESULTS: A total of 7785 adolescent patients satisfied inclusion criteria. The median age was 18 years, 1737 (22%) were male, and the median body mass index was 46. Of all patients, 6675 (86%) and 1310 (14%) underwent sleeve gastrectomy and gastric bypass, respectively. Preoperative chronic steroid use was significantly associated with higher rates of leak (odds ratio [OR] 7.327, P = .009), bleeding (OR 10.791, P = .003), and reoperation (OR 7.685, P < .001). While Pacific Islander race was also significantly associated with higher rates of reoperation (OR 11.773, P = .039), Asian race was significantly associated with higher rates of bleeding (OR 14.527, P = .042). A history of gastroesophageal reflux disease was associated with higher rates of postoperative reintervention (OR 2.306, P = .004). DISCUSSION: Readily identifiable preoperative patient characteristics are significantly associated with higher rates of postoperative complications following adolescent bariatric surgery. Additional research is required to determine whether tailoring treatment based on these characteristics can improve outcomes.

Assessing the Accuracy of Responses by the Language Model ChatGPT to Questions Regarding Bariatric Surgery.

PURPOSE: ChatGPT is a large language model trained on a large dataset covering a broad range of topics, including the medical literature. We aim to examine its accuracy and reproducibility in answering patient questions regarding bariatric surgery. MATERIALS AND METHODS: Questions were gathered from nationally regarded professional societies and health institutions as well as Facebook support groups. Board-certified bariatric surgeons graded the accuracy and reproducibility of responses. The grading scale included the following: (1) comprehensive, (2) correct but inadequate, (3) some correct and some incorrect, and (4) completely incorrect. Reproducibility was determined by asking the model each question twice and examining difference in grading category between the two responses. RESULTS: In total, 151 questions related to bariatric surgery were included. The model provided "comprehensive" responses to 131/151 (86.8%) of questions. When examined by category, the model provided "comprehensive" responses to 93.8% of questions related to "efficacy, eligibility and procedure options"; 93.3% related to "preoperative preparation"; 85.3% related to "recovery, risks, and complications"; 88.2% related to "lifestyle changes"; and 66.7% related to "other". The model provided reproducible answers to 137 (90.7%) of questions. CONCLUSION: The large language model ChatGPT often provided accurate and reproducible responses to common questions related to bariatric surgery. ChatGPT may serve as a helpful adjunct information resource for patients regarding bariatric surgery in addition to standard of care provided by licensed healthcare professionals. We encourage future studies to examine how to leverage this disruptive technology to improve patient outcomes and quality of life.

Patient and the Public's Perceptions of Bariatric Surgery: A Systematic Review.

INTRODUCTION: Bariatric surgery is an effective therapeutic modality for obesity and related comorbidities, yet it remains significantly underutilized. Patient perceptions and expectations may influence the decisions of eligible patients in pursuing surgery. METHODS: PubMed, SCOPUS, and OVID databases were searched in July 2022 to identify published studies discussing patient and the public's perceptions of bariatric surgery. RESULTS: The literature shows participants often reported bariatric surgery to be a life-changing intervention known to induce weight loss, improve obesity-related comorbidities, and improve quality of life. However, a significant proportion of survey respondents perceived bariatric surgery as unsafe or risky. Patients belonging to racial minority groups cited higher concern with mortality risk, lower weight loss expectations, and different motivations to pursue bariatric surgery. Female patients were significantly more likely to have more positive perceptions of, and higher expectations of weight loss from, bariatric surgery. CONCLUSIONS: The literature highlighted discordance between patient perceptions and the demonstrated clinical safety and efficacy profile of bariatric surgery. Overestimations of the risks, unrealistic expectations, and unfamiliarity with bariatric surgery outcomes were common findings. These perceptions of bariatric surgery may contribute to its underutilization among eligible patients. Perceptions and motivations often varied by race, region, sex, and age, which demonstrates the necessity of patient-centered education in the prereferral stage. The literature also demonstrated misconceptions of bariatric surgery among the public. Further research should explore the impact of education on the perceptions of patients and the public.

Impact of a Body Mass Index Threshold on Abdominal Wall Hernia Repair at a Safety-Net Hospital.

BACKGROUND: Body mass index (BMI) thresholds are utilized as a preoperative optimization strategy for obese patients prior to elective abdominal wall hernia repair. The objectives of this study were to determine the proportion of patients at our institution who ultimately underwent hernia repair after initial deferral due to BMI and to evaluate outcomes of those who required emergent repair during the deferral period. METHODS: A retrospective review was performed from 2016 to 2018 to identify all patients with abdominal wall hernias who were deferred surgery due to BMI. Patient characteristics, hernia type, change in BMI, progression to surgery, acuity of surgery (elective or emergent), and postoperative outcomes were examined. RESULTS: 200 patients were deferred hernia repair due to BMI. Of these, 150 (75%) did not undergo repair over a mean period of 27 months. The remaining 50 patients ultimately underwent repair, 36 of which (72%) were elective and 14 (28%) emergent. The mean initial BMI of the elective group was 35.3 ± 1.8, compared to 39.1 ± 5.3 in the no surgery group and 40.6 ± 8.2 in the emergent group (P < .01). While the elective group lost weight before surgery, the other groups did not. Patients who required emergent surgery had worse outcomes than those repaired electively. CONCLUSIONS: Preoperative weight loss is unsuccessful in most obese patients presenting for abdominal wall hernia repair at our institution. Patients who required emergent hernia repair had worse outcomes than those who underwent elective repair. Our institution's BMI threshold is a failed optimization strategy that needs to be reconsidered.

Lower Rates of Unplanned Conversion to Open in Robotic Approach to Esophagectomy for Cancer.

BACKGROUND: Minimally invasive approaches to esophagectomy have gained popularity worldwide; however, unplanned conversion to an open approach is not uncommon. This study sought to investigate risk factors associated with converting to an open approach and to evaluate outcomes following conversion. METHODS: Patients undergoing minimally invasive esophagectomy (MIE) for cancer were identified using the 2016-2019 Procedure Targeted NSQIP Database. Multivariable, stepwise logistic regression analysis was performed to investigate factors associated with unplanned conversion to open esophagectomy. Propensity-matched comparison of robotic (RAMIE) to traditional MIE was performed. RESULTS: A total of 1347 patients were included; 140 patients (10%) underwent conversion to open. Morbid obesity, diabetes, hypertension, American Society of Anesthesiologists class, and squamous cell carcinoma were associated with a higher likelihood of conversion. A robotic approach was associated with a lower likelihood of conversion to open (OR .57, 95% CI 0.32-.99). On multivariable analysis, squamous cell carcinoma pathology was the only variable independently associated with higher odds of conversion (OR 2.66, 95% CI 1.02-6.98). Propensity-matched comparison of RAMIE vs MIE showed no significant difference in conversion rate (6.5% vs 9.1%, P = .298), morbidity, or mortality. DISCUSSION: A robotic approach to esophagectomy was associated with a lower likelihood of unplanned conversion to open, and patients who were converted to open experienced worse outcomes. Future studies should aim to determine why a robotic esophagectomy approach may lead to fewer open conversions as it may be an underappreciated benefit of this newest operative approach.

Evaluating the Bariatric Safety Net: Analysis of Socioeconomic Factors and Outcomes at a Bariatric Safety Net Program Compared to an Affiliated Private Center.

PURPOSE: Obesity is prevalent among economically disadvantaged and racially underrepresented populations. It has been suggested that socioeconomic factors, race, and lifestyle habits are important factors associated with weight loss and comorbidity remission after bariatric surgery. This study analyzes outcomes of bariatric surgery at a private hospital (PH) versus an affiliated safety-net hospital (SNH). METHODS: Retrospective review of laparoscopic sleeve gastrectomies (LSG) performed by the same surgeons at a PH and SNH in a large metropolitan setting. Demographics, socioeconomic status, insurance status, weight metrics, and perioperative outcomes were compared. A postoperative telephone survey was conducted to study dietary and lifestyle differences between cohorts. RESULTS: Of the 243 LSG performed, 141 (58%) occurred at PH versus 102 (42%) at SNH. Most patients at SNH were Hispanic, lower socioeconomic status, and had government-sponsored insurance. Based off the results from the postoperative telephone survey, there were no significant differences in dietary and lifestyle habits between both cohorts. Postoperative weight loss outcomes were similar across cohorts. The two groups had similar percent excess weight loss (EWL) at all time points up to 36 months and similar rates of failure to achieve 50% EWL at 12 months. However, patients at PH had greater resolution of diabetes and hypertension after surgery. CONCLUSION: Our study demonstrates outcomes after bariatric surgery are similar at a PH and its affiliated SNH. Despite differences in race and socioeconomic factors between the two cohorts, perioperative outcomes, short-term postoperative weight loss, and weight loss failure rates were equivalent between SNH and PH patients.

Association of Postoperative Dieting, Exercise, Dietitian, and Surgeon Follow up With Bariatric Surgery Outcomes.

Although postoperative diet modification, exercise, and regular dietitian and surgeon follow-up are often recommended after bariatric surgery (BS), their impact on weight loss is unclear. A Retrospective chart review was conducted for patients who received sleeve gastrectomy or Roux-en-Y gastric bypass (RYGB) between August 2000 and November 2017 with telephone follow-up. Multivariable logistic regression models were used for analyses. There were 514 patients included in our study. Most were female (76.3%), mean age was 46.9 years (Standard Deviation [SD] = 11.8), and mean weight loss was 11.6 (SD = 6.5) BMI points at a mean follow-up of 7 years (SD = 4.3). Current surgeon follow-up OR = 2.08 (P < .01) was positively associated with postoperative weight loss, while current dietitian follow-up=OR .41 (P < .01) was negatively associated. Current weight loss supplement use OR = .45 (P = .03) was associated with reduced willingness to undergo surgery again. Increasing preoperative BMI OR = 1.06 (P = .04) and increasing age OR = 1.04 (P = .02) were associated with improved quality of life (QoL) due to BS. Lack of surgeon follow-up and regular dietician consultation was associated with suboptimal weight loss after BS. Older age was positively associated with improved QoL, while current weight loss supplement use was associated with lower likelihood of undergoing surgery again, both independent of weight loss.